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Abstract. We investigate necessary and sufficient conditions under which a general nonlinear affine 
control system with outputs can be written as a gradient control system corresponding to some pseudo- 
Riemannian metric defined on the state space. The results rely on a suitable notion of compatibility of the 
system with respect to a given affine connection, and on the output behavior of the prolonged system and 
the gradient extension. The symmetric product associated with an affine connection plays a key role in 
the discussion. 
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1. Introduction. A physically motivated class of nonlinear systems are gradient 
control systems, see |H|9j|21|22||23j|24l|25[ and the references quoted therein. These 
systems are described in the following way: they are nonlinear affine control sys- 
tems, which are endowed with a pseudo-Riemannian metric on the state space man- 
ifold. The drift vector field of the system is the gradient vector field associated with 
an internal potential function with respect to the pseudo-Riemannian metric, and the 
input vector fields are the gradient vector fields associated with the output functions 
of the system. Examples of gradient control systems include nonlinear electrical RLC 
networks, and dissipative systems where the inertial effects are neglected. In the case 
of RL or RC networks, the pseudo-Riemannian metric is positive-definite, and thus is 
a usual Riemannian metric, while for general RLC networks the metric is indefinite. 
We refer to I4 l91 l23ll24l for more background on the modeling of nonlinear networks 
as gradient systems. 

Another relevant class of nonlinear systems is the family formed by the Hamil- 
tonian control systems. In this case, the state space manifold is equipped with a sym- 
plectic form. The drift vector field and the input vector fields are the Hamiltonian 
vector fields associated, respectively, to an internal energy function and the output 
functions of the system with respect to the symplectic form. Hamiltonian equations 
are of central importance in the modeling of physical systems as they are the start- 
ing point to describe the dynamics of a very large class of phenomena, including 
mechanical, electrical and electromagnetic systems. 

Apart from their physical and engineering importance, gradient and Hamilto- 
nian systems also possess very peculiar mathematical properties. For instance, a 
linear input-state-output system is a Hamiltonian control system 1 5 [ (respectively a 
gradient control system |25|) if and only if its impulse response matrix W(t) satisfies 
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W(t) = -W T (-t) (respectively W(t) = W T (t)). Although they are typically not 
amenable to linearization techniques, their rich geometric structure makes possible 
to combine powerful tools from Nonlinear Control Theory Differential Geometry 
and Classical Mechanics in the study of a variety of problems including stability and 
stabilization, input-output decoupling, structural synthesis and interconnection. 

Their theoretical and practical relevance, together with their meaningful geo- 
metric properties and the wide range of results available for them, make the classes 
of Hamiltonian and gradient systems distinct within the family of nonlinear affine 
control systems. This explains the interest in identifying those systems that can be 
written as either Hamiltonian or gradient. This characterization problem is motivated 
by the Realization Problem in Systems Theory and the Inverse Problem in Mechan- 
ics. The Realization Problem addresses the question of when the input-output map 
of a system can be realized as the external behavior of a Hamiltonian (respectively 
gradient) input-output system. The Inverse Problem, which has a longstanding his- 
tory in mathematical physics, poses the question of when a second-order differential 
equation can be realized as the Euler-Lagrange equations corresponding to certain 
Lagrangian function. For further reference on these problems, the reader is referred 

to OEElELlIin). 

In 11111121 . necessary and sufficient conditions were given under which a mini- 
mal nonlinear affine control system with an equal number of inputs and outputs is a 
Hamiltonian control system with respect to some symplectic structure, which turned 
out to be unique. In the present paper we describe an analogous theory for the case 
of gradient systems. As we discuss below, there are a number of key differences in 
the treatment of the characterization problem for the Hamiltonian and the gradient 
case, which make the latter more involved. The role played in the Hamiltonian set- 
ting by the Lie bracket and the Hamiltonian vector fields is taken in the gradient 
setting by the symmetric product associated with an affine connection and the gradi- 
ent vector fields. A fundamental observation is that, while every input-state-output 
system admits a natural extension to a Hamiltonian system living on the cotangent 
bundle of its state space, the construction of a gradient extension on the cotangent 
bundle relies on the selection of a torsion-free connection on the state space. This 
motivates the introduction of a novel compatibility condition of the given nonlinear 
system with the selected affine connection guaranteeing an appropriate choice of the 
latter one. The compatibility condition is expressed as a relation of the symmetric 
products of the drift vector field and the input vector fields with the output func- 
tions of the system, and turns out to play a prominent role in the characterization of 
gradient control systems presented in Theorem l5.4l below. 

The paper is organized as follows. In Section[2]we present the class of nonlinear 
systems considered along the paper. We also introduce the notions of prolongation 
and gradient extension of a nonlinear system, whose observability properties are 
studied in Section [3] Section [3] introduces the concept of (weakly) externally equiv- 
alent systems. In Section|51 we introduce the important notion of compatibility be- 
tween a nonlinear system and a given affine connection. At this point, we are ready 
to state and prove the main result of the paper, namely the characterization of when a 
general nonlinear control system is gradient. In Section|6|we investigate the unique- 
ness (up to isometry) of gradient realizations with the same input-output behavior 
and we give an alternative proof of a result in 1 1 2 1 . We present our conclusions in 
Section |7| Finally, an appendix in Section [S] contains a simplifying result concerning 
the checkability of the compatibility condition for a nonlinear affine control system. 
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2. Setting. Let M be an n-dimensional differentiable manifold. We will denote 
by TM, T*M the tangent and cotangent bundles of M, by X(M) the set of smooth 
vector fields on M, by f2 x (M) the set of smooth one-forms on M, and by C°°(M) 
the set of smooth functions on M. Throughout the paper, the manifold M and the 
mathematical objects defined on it will be assumed to be real-analytic. 

Consider a nonlinear control system S with state space M , affine in the inputs, 
and with an equal number of inputs and outputs, 



£ : < 



x = 9o{x) +^2u j g j (x) 
k V] = Vj(x), j = l,... 



(2.1) 



where x G M, x(0) — x and u — (m, . . . ,u m ) G U C M m . The vector fields 
go, gi, . . . , g m on M are assumed to be complete and V\, . . . , V m are real-valued func- 
tions on M. The set U is the control space, which for simplicity is assumed to be an 
open subset of R m , containing 0. The function u(t) — (ui(t), . . . , u m (t)) belongs to a 
certain class of functions of time, denoted by U, called the admissible controls. For our 
purposes, we may restrict the admissible controls to be the piecewise constant right 
continuous functions. 

An important subclass of the family of nonlinear systems P. It is formed by the 
Hamiltonian control systems, see |12|. Here, we will instead focus our attention on 
the family of gradient control systems. Let Q be a pseudo-Riemannian metric on M, 
i.e. a non-degenerate symmetric (0,2)-tensor on M (not necessarily positive definite). 
Consider the 'musical' isomorphisms associated with Q, \>g : X(M) — > Q}(M), jjg : 
n 1 (M) -> X(M) defined by 



\> g (x)(Y) = g(x,Y) , ttcH = bg 1 (w) ) 

where X, Y e X(M) and cj e Q 1 (M). The gradient vector field associated with a 
function V G C°°(M) is given by grad g V — §g(dV). Reciprocally, a vector field 
X 6 3£(M) is said to be locally gradient if the one-form bg(X) is closed. By Poincare's 
lemma, this is equivalent to saying that there exists a locally defined function V G 
C°° (M) such that \>g(X) = dV. If this equality holds globally, X is called gradient and 
will be denoted by X = grad g V. Along the paper, we will drop the subindex when 
it is clear from the context the pseudo-Riemannian metric with respect to which the 
gradient vector field is computed. If we fix coordinates (x 1 , . . . , x n ) on M, then the 
pseudo-Riemannian metric can be locally expressed as Q = Q a bdx a <E) dx b , where 
(Q ab = tJLj )) is a symmetric matrix. The musical isomorphisms are then given 
by b e = g a tdx a ® dx\ (t = S 06 ^ 8> where (a ab ) is the inverse matrix of (g oi ). 
Finally, the gradient vector field associated with V reads 



gradg V - G ab 



, dV d 

dx b dx a 

Now, assume that the state space M in 12.1 1 is a pseudo-Riemannian manifold, 
(M,Q). Furthermore, assume that the drift vector field go is locally gradient and 
the input vector fields gj, j = 1, . . . , m are gradient with respect to the functions 
Vi, . . . , V m , i.e. <?j = grad e Vj, j = 1, . . . , m. Then, the resulting system 

m 

y . ^ ffo (at ) + X) «j (*) S rad e Vji W . ( 2 2 ) 

yj = V^f(a;), j = l,...,m, 
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is called a locally gradient control system on M. If the drift g is a gradient vector field, 
then the system is called a gradient control system on M. 

Our objective is to characterize when a nonlinear system of the form \2.1\ is ac- 
tually a locally gradient control system \2.2\ . i.e. find necessary and sufficient condi- 
tions for the existence of a pseudo-Riemannian metric on the state space M such that 
the system i2.ll equals system \2.2) . These conditions will be given in terms of the 
output behavior of the so-called prolonged system and the gradient extension of S, 
which we describe next. 

2.1. The prolongation of a nonlinear system. Given an initial state x{Q) = x , 
take a coordinate neighborhood of M containing xq. Let x(t), t £ [0, T] be the solution 
of J2.ll corresponding to the input functions u(t) = (ui(t), . . . , u m {t)) and the initial 
state x(0) = x , such that x{t) remains within the selected coordinate neighborhood. 
Denote the resulting output by y{t) — (yi(t), . . . , y m {t)), with yj(t) = Vj(x(t)). Then 
the variational system along the state-input-output trajectory (x(t), u(t), y(t)) is given 
by the following time-varying system, 

fi m ft m 

m = ^{x{t))v{t)+Y J u^t)^{x{t))v{t)+Y. u >M^)^ 

3 = 1 3 = 1 

y](t) = ^(x(t))v(t), j = l,...,m, (2.3) 

where v(0) = v e R n , and u p = {u\, . . . , u v m ), y v = (y\, . . . , y w m ) denote the in- 
puts and the outputs of the variational system. The reason behind the terminology 
'variational' comes from the following fact: let (x(t, e), u(t, e), y(t, e)), t S [a, b] be a 
family of state-input-output trajectories of I2.lt parameterized by e € (— <5, S), with 
x(t,0) = x(t), u(t,0) = u(t) and y(t,0) = y(t), t e [a, b]. Then, the infinitesimal 
variations 

«(t) = ^(t,0), «"(t) = g(t,0), y v (t) = f e (t,0), 

satisfy equation 12.31 . Additionally, if the initial state is the same for the whole family 
of trajectories, x(0, e) = xq, then the variational state v(Q) at time is necessarily 0. 

The prolongation or prolonged system of J2.ll corresponds to considering together 
the original system 12.11 and the variational system, 



3 = 1 

„ m „ m 

m = ^(x(t)Ht)+Y,Mt)^(x(t)Ht)+^gMt)), 

3 = 1 3 = 1 

dV 

yj =Vj(x), y](t) = -^(x(t))v(t), j = l,...,m, (2.4) 
with inputs Uj, vR, outputs yj, y^ and state (x,v). To state a coordinate-free defi- 



nition of the prolonged system i2Al on the whole tangent space TM, we need to 
introduce the notions of vertical and complete lifts of functions and vector fields. 
We do this following \26\. Given a function V on M, the complete lift of V to TM, 
V c : TM — > R is defined by V c (v) = (dV, v). In the induced local coordinates on 
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TM, (x 1 ,...,x n ,v 1 ,..., v n ), this reads 

a— 1 

The vertical lift of V to TM, V v : TM -> R, is defined by V^ v = o r M , where t m 
denotes the tangent bundle projection. Given a vector field X on M, the complete lift 
of X to TM, X c e X(TM) is defined as the unique vector field verifying X c (f c ) = 
(Xf) c , for any / G C°°(M). Alternatively, if $ t : M -» M, t G [0, e) denotes the flow 
of X, then we can define X c as the vector field whose flow is given by ($t)* : TM — > 
TM. In local coordinates, 

a=l a,fc=l 

The pert/caZ /iff of X to TM, X v G X(TM) is the unique vector field such that 
X v {f c ) = (XfY, for any / G C*°°(M). In local coordinates, 

X v (x,v)=Y X ^d^- (Z6) 

a—l 

The following definition provides an intrinsic way of pasting together the sys- 
tem J2.ll with the variational systems associated with its state-input-output trajecto- 
ries. 

Definition 2.1. The prolonged system E p of a nonlinear system S of the form i2.ll z's 
defined by 

!rn m 
x p = gl{xp) + J2 u i( t )9 C j {xp) + uP j(tyJ( x p) ( 2 7) 

Vj = V J( x p) ) = ^/(^p) > J = 1) ■ ■ • , m , 

where x p — {x, v) G TM, and x p {Q) = (x ,v ). 

One can easily check that in the induced tangent bundle coordinates, the local 
expression of the system 12.71 is precisely 12.41 . 

Remark 2.2. In the same way as we have presented above, one can also in- 
troduce the notions of adjoint variational system and Hamiltonian extension of the 
nonlinear system d2.ll . These notions play a key role in the characterization of when 
a general system admits a Hamiltonian description, see |12|. 

2.2. The gradient extension of a nonlinear system. When dealing with the 
Hamiltonian extension of a nonlinear system, one relies on the fact that the cotangent 
bundle is endowed with a canonical symplectic structure. However, this is not the 
case when treating gradient systems, since a canonical pseudo-Riemannian structure 
on the cotangent bundle does not exist. In order to define the gradient extension of a 
nonlinear system of the form J2.ll , we will first select a torsion-free affine connection 
V on M, and then consider its Riemannian extension to T* M (cf . 1 18 1). 

Let us briefly present some basic notions on affine connections and Riemannian 
geometry. An affine connection 1 15 1 on a manifold M is defined as an assignment 

V : X(M) x X(M) — ► X(M) 
(X,Y) .— ► V X Y 
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which is K-bilinear and satisfies V fX Y = f\7 x Y and V x (fY) = fV x Y + X(f)Y, 
for any X,Y e X(M), f G C°°(M). This implies that V x Y(x) only depends on X(x) 
and the value of Y along a curve which is tangent to X at Let c : t G [to, ^i] l_ > 
c(i) = (a; 1 (i), . . . , ir n (t)) G M be a curve on M and W a vector field along c, i.e. a 
map W: [t , h] -> TM such that r M (W(t)) = e(t) for all t G [a, b\. Let V be a vector 
field that satisfies V(c(t)) = W{t). The covariant derivative ofW along c is defined by 

^^ = V m W(t) = V m V(x)\ x=c[ty 

This definition makes sense because of the defining properties of the affine connec- 
tion. Now, we may take W(t) = c(t) and set up V<;(t) c(t) = 0. This equation is called 
the geodesic equation, and its solutions are termed the geodesies of V. In local coordi- 
nates, this condition can be expressed as i a + T^ c (x)x b x c = 0, 1 < a < n, where the 
^bc( x ) are Christoffel symbols of the affine connection, defined by 



d d 
— dx c bcK ' dx a 



The vector field S on TM describing the geodesic equation is called the geodesic spray 
associated with the affine connection V. In local coordinates, 

S = v a - T a bc (x)v b v c — . 

Q x a bc\ ) gva 

Therefore, the integral curves of the geodesic spray S are the solutions of the geodesic 
equation. The torsion tensor of an affine connection is defined by 

T : X(M) x X(M) — ► X(M) 

(X,Y) ^V x Y-V Y X-[X,Y], 



Locally, we have 



( dx a, dx b > { ab ba, dx c ' 



Given an affine connection, the symmetric product 1171 of two vector fields X, Y G 
X(M) is defined by the operation 

(X :Y)= V X Y + V Y X . 

The geometric meaning of the symmetric product is the following 1 16 1: a distribution 
T> on M is geodesically invariant (meaning that each geodesic of V whose initial 
velocity is in V has all its velocities in V) if and only if (X ; Y) G V, for all 1,7 eD. 
The symmetric product plays a crucial role within the so-called affine connection 
formalism for mechanical control systems in the study of a variety of aspects such as 
controllability, series expansions, motion planning and optimal control |6|. 

Associated with the metric Q there is a natural affine connection, called the Levi- 
Civita connection. The Levi-Civita connection V e is determined by the formula 

2 G{V S X Y, Z) = X(G(Y, Z)) + Y(Q(Z, X)) - Z{Q{X, Y)) 

+ g(Y, [z, x]) - g(x, [y, z\) + g{z, [x, y]) , x,Y,ze x(M) . 
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One can compute the Christoffel symbols of V e to be 



1 oc = o£ -tt— + -7TT ~ -tt-t ■ (2.8) 



2 \3x c 3x b 3x d 

The Levi-Civita connection is torsion-free, that is T(X, Y) — 0, for any X, Y £ X(M). 

Therefore, a pseudo-Riemannian metric on M defines a unique affine connection 
on M , but the converse is not always true. Given a pseudo-Riemannian metric ^ on 
M, we can define the so-called Beltrami bracket |9 21 J of functions on M, 

U ■ 9}g = S(grad 6 /, grad g g) , /, 5 e C°°(M) . 

In local coordinates, one has the expression, 

It is interesting to note that the mapping 

grad e : (C°°(M),{- : -}g) - (X(M), (• : -} vS ) 

is a homomorphism of symmetric algebras, i.e., grad g {/ : g}g = (grad g / : grad e g)^g, 
foraE/,5 G C°°(M). 

REMARK 2.3. The latter observation is the gradient analog of the following fact 
in the Hamiltonian setting: consider the mapping (C°°(M), {•, •}) — > (X(M), [•, •]) 
(where {•, •} denotes the Poisson bracket and [•, •] denotes the Lie bracket), associ- 
ating to each function / its Hamiltonian vector field Xf. Then this mapping is a 
homomorphism of Lie algebras, i.e. Xy 9 j = [Xf, X g \. 

Let us now turn our discussion to the cotangent bundle of M. First, we introduce 
the construction that associates to each vector field X on M a function V x on T*M, 
defined by V x (x,p) = (p, X{x)). The notion of vertical lift of a function V on M to 
a function V v on T*M is given by V w = V o -k Mi where ttm is the cotangent bundle 
projection. An object which will play a key role in the subsequent discussion is the 
Riemannian extension 1 18 26 [ of a torsion-free affine connection. Let V be a torsion- 
free affine connection on M. Then, V defines a pseudo-Riemannian metric on T*M, 
denoted Q c , as the unique (0,2)-tensor on T*M which satisfies 

g c (x c ,Y c ) = -v {X:Y) . 

The fact that this single equality completely determines the Riemannian extension Q c 
is a consequence of the result in Proposition 4.2 in Chapter VII of |26|, which asserts 
that any (0, s)-tensor field on T*M is univocally defined by its action on the complete 
lifts of vector fields of M. The matrix representations of the musical isomorphisms 
defined by Q c in the induced local coordinates (a; 1 , . . . , x n ,pi, . . . ,p n ) on T*M are 
given by 

* ■ ( -r- o ) . * ■ ( i ) ■ 

As for the gradient vector fields associated with the functions V x , V v E C°°(T*M), 
X e X(M), V £ C°°(M), one has the local expressions 

f) I BX a \ 3 BV 3 
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Definition 2.4. The gradient extension E e of a nonlinear system E of the form J2.ll 
with respect to a torsion-free affine connection V on M is given by 

{m m 
x e = grad e c y ff0 (a: e ) + Uj if) gradgc V* (x e ) + £ Uj e (t) grad e c F/(z e ) , 
Vj = Vy(x e ), vf = V8*(x e ), i = l,...,m, 

(2.11) 

zw/iere a; e = G T*M, x e (0) — {x ,pa), u — {u\, . . . ,u m ) G U C R m , flnd u e = 

K,...,<„)eIR'». 

REMARK 2.5. Note that the gradient extension E e is itself a gradient control 
system. 

3. Observability of the prolongation and the gradient extension. In this sec- 
tion, we investigate the observability properties of the prolonged system and the 
gradient extension of a nonlinear system. We start by briefly reviewing some no- 
tions such as distinguishable points and local observability. 

Let y denote the space of absolutely continuous functions on M with values in 
M." 1 . For a nonlinear system of the form i2.ll . the input-output map 71% : M x U — > y, 
TZy,(xq, u(t)) = y(t) is defined by assigning to each initial condition xq G M and any 
admissible control u(t) €U the output of the system, 

V{t) = (Vi(x(t,x 0) u(t))), . . . ,V m (x(t,x ,u(t)))) , 

where x(t, xq, u(t)) denotes the solution of x = 9o( x ) + J2]Li u j(t)9j( x ) starting ataro- 
Now, two points xi, 2:2 G M are said to be indistinguishable, x\ ~ X2,if TZ^(xi,u(-)) = 
TZy,(x 2 ,u(-)) for any u(-) G U. 

Definition 3.1. A system E is observable if for any x\, x 2 G M, one has that 
x\ ~ X2 => x± — x 2 - Alternatively, for any x\ ^ x 2 , there exists an admissible control such 
that the output functions resulting from the initial conditions x(0) = X\, resp. x(0) = x 2 , 
are different. The system is locally observable at xq if there exists a neighborhood M of Xq 
such that this holds for points in M. 

Denote by H the R-linear space in C°° (M) spanned by the functions of the form 
C Xl Cx 2 ...Cx.Vj, with {X r } s r=l c {gt \ i = 0, 1, . . . ,m}, and j e {l,...,m}. Al- 
ternatively, we may take X r to be arbitrary elements of the accessibility algebra cor- 
responding to the vector fields g ,gi, . . . , g m . H is called the observation space of E. 
It follows from the analyticity assumption that the system is observable if and only 
if H distinguishes points in M, i.e. for every x\, x 2 G M with x\ ^ x 2 , there exists 
V G H such that V(x{) ^ V{x 2 ), cf. E3). 

Proposition 3.2 (|12|). Consider a nonlinear system E of the form J2.ll , with 
observation space Tt. Then, the observation space W of the prolongation YP is given by 
H p = H c + H v , where H c — {V c \ V G H} and H v = {V v \ V G H}. 

The following corollary is a modified statement of Corollary 3.3 in 1 12 1. 

Corollary 3.3. Assume the codistribution dTL is of constant rank. Then the system 
E is (locally) observable if and only if its prolongation is (locally) observable. 

Proof. Following |13|, E is locally observable if and only rk(cW) = dimM. In 
addition, the codistribution dTL on M has constant rank if and only if the codistri- 
bution dW on TM has constant rank. Therefore, rk(dTL) = dimM if and only if 
rk(d?i p ) — dim TM if and only if E p is locally observable. The statement regarding 
observability is proved as in Corollary 3.3 in 1 12 1. □ 

Let us turn our attention to the observability properties of the gradient extension 
of a nonlinear system of the form J2.lt . The following lemma will be most helpful. 
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Lemma 3.4. Let V be a torsion-free affine connection on a manifold M, and let Q c 
denote its Riemannian extension to T*M. Then, for any vector fields X,Ye X(M), and 
any functions f,g& C°°(M), the following identities hold 

(i) (grad e c V X )(V Y ) = {V x : V Y }gc = V^ Y ) = -G C (X C ,Y C ). 

(ii) (grad ec V x )(f) = (grad 5 c r)(V x ) = {V x : / v } 6 c = X(f)\ 
(Hi) (grad e c/ v )( ff v ) = {/ v :. 9 v } e c=0. 

Proof. The first equality in (i) is the definition of the Beltrami bracket associated 
with Q c . For the second one, we resort to the local expressions in 12.91 to compute 

x . _ 9X a A / I \ / dY a .> T 



dx b ' J 




'0 


dX a , 
Y b 4 

dx b 




dx b 



The third equality corresponds to the definition of £ c . The first and second equalities 
in (ii) follow again by definition. As for the third one, note that 

**,r<y*)- -gr-w 

Finally, the equalities in (iii) are straightforward. □ 

Denote by So the R-linear space in X(M) spanned by the vector fields of the 
form (Xi : (X 2 : (. . . : (X, : 9j )) ...)), with {X r } s r=1 C { 9l \ i = 0,1,..., m), 
and j G {1, . . . , m}. Alternatively, one can define So as the smallest subspace of 
X(M) such that (i) g 1: .. .,g m G S" ; and (ii) if X e S , then {g t : I) 6 S for all 
i = 0, 1, . . . , m. We denote by Sq the distribution on M generated by the space So, 

S (x) = sp&n{X(x) X E So} , x G M . 

Proposition 3.5. Consider a nonlinear system E of the form 12.11 . z»zf/z observation 
space H. Let V be a torsion-free affine connection on M. Then, the observation space Ti. e of 
the gradient extension E e is given by H e = V s " + (U + h) v , where V s " = {V x \ X G 
S } and 1} is spanned by £ Xl Cx 2 ■ ■ ■ £x 3 £xVj, with X r , r — 1, . . . , s, equal to g ir i = 
0, 1, . . . , to, X E So and j = 1, . . . , to. 

Proof. The observation space of the gradient extension of E is spanned by 

£xi £-x 2 ■ ■ ■ £-x 3 Vj , Cx t Cx 2 ■ . . Cx 3 y 9] i 

where X r , r = 1, . . . , s is equal to grad gc V 9i , gradgc VJ , i = 0, 1, . . . , m, j = 1, . . . , m. 
Now, using Lemma f3.41 we have that 



£ gI -ad 5 c vn VJ = (Cg^Y , C ffadgc vm V<>i = V^) , 

£gr adg c vj n v = , £ gradg c vj V 3k = (C gk V 3 )\ 



with i = 0, 1, . . . , m and j,k = 1, . . . , to. Considering the next step of Lie derivatives 
yields 



= {c {g ,. 9]) v k y , £ gradsc n {c 9i v 3 y = o , 



with h = 0, 1, . . . , m. Further iterating this process, we get to the desired result. □ 
Corollary 3.6. Consider a nonlinear system E of the form <2.1> , with observation 
space H. Assume the codistribution dTL is of constant rank. Let V be a torsion-free affine 
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connection on M and further assume that the distribution S is full-rank. Then, £ is (locally) 
observable implies that £ e is (locally) observable. 

Proof. Since the codistribution dH has constant rank, £ is locally observable if 
and only if dimdH(x) = dimM. Since <5>o is full-rank, it is clear that £ locally ob- 
servable implies that TL e has constant maximal rank, and therefore £ e is locally ob- 
servable. With respect to observability, let (x\,p\), (x 2 ,p 2 ) G T*M and assume that 
V e {x ljPl ) = V e (x 2 ,p 2 ) for all V e £ W. Since W C H e , this yields V(xt) = V(x 2 ) 
for any V £ Ti. So, under observability of £, we conclude that x\ = x 2 — x. Then, we 
have that V x (x.p\) = V x (x,p 2 ), for all X £ So, which finally implies that p\ = p 2 . 
□ 

4. Externally equivalent systems. In this section we introduce the notion of 
(weakly) externally equivalent systems, which will be instrumental in the statement 
of the main result in Section[5] Consider two nonlinear systems a = 1 , 2, of the form, 

m 

V 3 a {x a ) , j = 1, . . . , m , u = (u u . . . , u m ) eU C W n . 

Denote by Ti a , a = 1,2, the associated observation spaces. Take a function H l £ 
H\ H 1 = £ Xl . . . C Xs V}, with X r = gj r , i r e {0, 1, . . . , to}, r = 1, . . . , s and j € 
{1, . . . , to}. Consider the function in H 2 defined by H 2 = £ Yl ■ ■ ■ £-y 3 V 2 , with Y r 
(if , r - \ ..... s. Then we say that H 1 and H 2 formally correspond to each other. This 
notion is useful to define the concept of weakly externally equivalent systems. 

Definition 4.1. The systems E 1 and S 2 are weakly externally equivalent if and only 
if for all x 1 e M 1 , there exists x 2 e M 2 such that H 1 (x 1 ) = H 2 (x 2 )for all corresponding 
H 1 £ Ti 1 , H 2 £ TC 2 , and vice versa. 

Definition 4.2. The systems E 1 and E 2 are externally equivalent if and only if for all 
x 1 G M 1 , there exists x 2 £ M 2 such that the input-output maps corresponding to x 1 and 
x 2 coincide, i.e. 7£ E i (x 1 , u(-)) = TL^ (x 2 ,u(-)),for all u(-) £ U, and vice versa. 

Equivalently, E 1 and E 2 are externally equivalent if and only if their behaviors 
are equal. Clearly, if two systems are externally equivalent, then they are weakly 
externally equivalent. 

PROPOSITION 4.3. Assume that E 1 and E 2 are weakly externally equivalent, observ- 
able and that the codistributions dH a , a — 1,2, have constant rank. Then there exists a 
unique diffeomorphism ip : M 1 — > M 2 with (p*{TL 2 ) = H 1 . 

Proof. Let x 1 £ M 1 . By definition, there exists x 2 £ M 2 such that H 1 (x 1 ) — 
H 2 (x 2 ) for all corresponding H 1 £ H 1 , H 2 £ K 2 . Since Ti. 2 distinguishes points 
in M 2 , it follows that x 2 is unique. Define ip : M 1 M 2 , fix 1 ) = x 2 . Using 
dim dH 2 — dim M 2 and the inverse function theorem, it follows that <p is smooth. 
Indeed, for each x 2 £ M 2 , there exists a neighborhood V of M 2 at x 2 and dim M 2 
independent functions H 2 ■ H% M2 on V, such that ip is given by 

x 2 = (H 2 , . . .,Hl mM ,)-\Hl . . ..f&^X* 1 ) • 

Analogously, we can construct the inverse mapping ip~ x : M 2 —> M , making use of 
the fact that £1 is observable, which concludes the proof. □ 

Corollary 4.4. Let the systems E 1 and E 2 be observable and the codistributions 
dH a , a — 1,2, have constant rank. Then E 1 and E 2 are weakly externally equivalent if and 
only if they are externally equivalent. 
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Proof. We already know that if the systems are externally equivalent, then they 
are weakly externally equivalent. Conversely, assume that S 1 and E 2 are weakly 
externally equivalent. From Proposition 14.31 we have that there exists a diffeomor- 
phism ip : M l — > M 2 with (p*(H 2 ) — TC 1 . Using this latter fact, and since the vector 
fields (?q, g l j are determined by their action as derivations on Ti. a , a — 1,2, we con- 
clude that ip*gl = g 2 ,, ip^g^ = g 2 , j = 1, . . . , m. □ 

Remark 4.5. The map tp in the previous proof is called a state space diffeomor- 
phism. 



5. Gradient realization of a nonlinear control system. This section contains 
the main result of the paper. Under certain technical conditions, Theorem l5.4l below 
characterizes when a nonlinear control systems admits a gradient realization. Before 
stating this result, we need to introduce the novel notion of compatibility between a 
nonlinear system and an affine connection. 

Definition 5.1. Let V be an affine connection on M. A nonlinear control system £ 
of the form 12.11 is compatible with V if and only if the following two conditions hold: 

(a) For all vector fields X±, . . . , X S1 , Y\, . . . , Y S2 e {go, <7i, • ■ ■ , g m }, and all indexes j, k = 
l,...,m, 



£(X 1 :(X 2 :(...:(X 31 :g J ))...)) [C Yl Cy 2 . . . L Ys2 Vfe] 

= £-(Y 1 :(Y 2 :(..,.(Y S2 :g k ))...)) [C-X 1 C-X- 2 ■ ■ ■ C Xs Vj] 



(b) For all vector fields X u ..., X S1 , Y 1 , . . . , Y S2 , Z 1 , . . . , Z S3 e {g 0l gi,..., g m }, and all 
indexes j, k, I = 1, . . . , m, 



^((X 1 :(X 2 :(...:{X sl :g J ))...)):{Y 1 -.{Y 2 -.{..,.{Y S2 :g k ))...))) [C Zl Cz 2 • • • £z, 3 Vi\ 



- C(Z 1 :(Z 2 :(..,.(Z S3 :g l ))...)) 



£{X 1 :(X 2 :(...:{X sl :g j ))...)) [C Yl C-Y 2 ■ ■ ■ Cy s2 V k ] 



Remark 5.2. Note that a locally gradient control system of the form 12.21 is 
compatible in the above sense with the Levi-Civita connection associated with the 
pseudo-Riemannian metric Q. Indeed, let (■ : •}, {■ : •} denote, respectively, the 
symmetric product and the Beltrami bracket corresponding to V e and Q. Take X ri = 

gradV^, Y r2 = grad Vp r , Z r3 = gradKy r3 , r» 6 {1, .. .,s,} (which can always be 
written at least locally), then 



£(X 1 :(X 2 :(..,.(X sl :g ] ))...)) [^1^2 • • • Vfc] 

= ^grad{V r 0tI :{V a3 :{...:{V 01 , 1 :^}}...}} [{Vpi ■ {Vf3 2 ■{■■■■ {Vp^ ■ Vfe}} . . .}}] 

= £g^d{v Pl -.{v ff:i -.{...-.{V -.v k }}...}} [{V ai : {V a2 :{...: {V a<tl : Vj}} ...}}] 



c 



(Y 1 :(Y 2 :(...:(Y S2 :g k ))...)) 



[c Xl c 



x 2 
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and 



£((X 1 :(X 2 :(...:(X sl :g J ))...)):(Y 1 :(Y 2 :(...:(Y sl :g k ))...))) [CZi.Cz* ...C Zs .Vl] 

= -Cgrad{{V Q1 :{y c , 2 :{...:{K lsl :y j }}...}}:{y /jl :{^ 2 :{...:{y^ 2: y fc }}...}}} 

[{V 7l : {V l2 :{...: \\. , : ■ ■ •}}] 



£grad{V T1 :{V T2 :{...:{V 7s „ : V, }} ■ • •}} 



[{{V ai : {V a2 :{...: {l„ : ...}}: { \ : 1 1 :{...: {I,.. : 14}} ■ ■ •}}}] 

= £(Z i: ^M-:<iW9!»-» [£(Xi:(X a :(...:(X. 1 :g j ))...)) [Cy 1 Cy 2 . . . Cy s V k ] 

REMARK 5.3. In case the distribution Sq is full-rank, note that property (b) in the 
above definition implies property (a) up to a constant on each connected component 
of M. To see this, one can use the symmetry of the symmetric product to deduce 
from (b) that 



-(Z 1 :(Z 2 :(...:(Z s ,:g l ))...)) 



£(X 1 :(X 2 :(...:(X tl :gj})...)) [C Yl C Y . 2 ■ ■ ■ C Ys V k ] 

£(Y V .{Y 2 :{...:{Y B2 :g k ))...)) [Cx ± Cx 2 ■ ■ ■ C-X„ x Vj] 



- £(Zi:(Z a :(...:(Z, 3 :g,})...)) 

Now, one concludes the result from the full-rankness of Sq. Another interesting ob- 
servation in this case is that the checkability of the compatibility condition can be 
performed taking a basis of vector fields in So as we discuss later in Lemma IcTTl 
Now, we come to the main result of the paper. 

Theorem 5.4. Let T,bea nonlinear control system of the form J2.1> . Let V be a torsion- 
free affine connection defined on the state manifold M. Assume £ is observable with dim dH 
constant, compatible with V and that the distribution Sq is full-rank. Then, £ is a locally 
gradient control system if and only if its prolonged system £ p and its gradient extension £ e 
are weakly externally equivalent. 

Proof. =>) Consider a locally gradient control system £ on (M, Q) (cf. {12,21 ). to- 
gether with its prolongation £ p on TM and its gradient extension £ e on T*M. Recall 
that in the induced bundle coordinates (x a ,v a ) on TM, (x a ,p a ) on T*M, the musi- 
cal isomorphisms associated with Q read \>g(x a ,v a ) — (x a ,Q a bV b ) and §g{x a ,p a ) — 
(x a , Q ab pb). We are going to show that \>g is actually an isomorphism between the 
prolongation and the gradient extension, i.e. we will prove that \>g(x p (-)) = x e (-) 
along the solutions of \2.7\ and J2.ll> respectively. This will be a consequence of the 
following equalities 

(\>g)^ = grad ec V" obg, V^o\> G =Vf 1 

(bgU] = grad e c VJ o \> g , V/obg^Vj, V- L > 

for alH = 0, 1, . . . , m, j — 1, . . . , m. In order to show d5.lt . we will make use of the 
following identities, 

^ ( JL\ - A m dGcb b A \ fJL\ - r 9 

( G) * \dx°)~ dx° + dx" V d Pc ' [ g) * \dv«J~ yah d Pb ' 
Let g £ X(M). In local coordinates, g = g a d/dx a . Using ( 12.51 , we get 

w C \ a d ( c dG ab dg c \ b d 
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On the other hand, we have that 



grad ec 7" o b g = fl « A + |g bc |g + 2& c r^} , f 



Now, suppose that g is a locally gradient vector field. In local coordinates, this 
means that Q ac g c = dV/dx a , for a certain function V, which in turn implies that 

d{Gac9 c }/dx h = d{Q bc g c }/dx a , that is 

r dtf_ _ dGbc c r dg^_ dGac c 
yac dx» ~ dx" 9 +ybc dx a dx b 9 ■ 

Substituting into the above expression for (be;)* (g c ), 

d { c dGab , dGbc c , - dg c 8Gac c \ b d 



/L \ I C\ a w i J c^^ab ^Vbc c n ^Vac , 

Q>Q)* 9X7 + JiIa-9 + Gbcjr- ~ -jr^g 



v 



dx a \ dx c dx a dx a dx b J dp a 

d , / _c ( ®Gab , dGbc dGac \ , n dg c \ b d 



^ dx a \ \ dx c dx a dx b ) bc dx a J <9p a 



.9 



Therefore, the first equality in J5.lt holds for every % = 0,1,..., m. The equality 
C>a)*ffJ = g ra dc; c V] t>s, j = 1, • ■ ■ , ni, follows by considering J2.6I and the fact that 
the vector fields gj are gradient by hypothesis, 

M. Cff v ) = Gab9 b ^- = = grad,c ^ o b e . 

As for 1/ 9 j o b e = Vf , for each u e T X M, we compute V* o bg(u) = Gabv h g°; = 
dVj/dx b ■ v b —< dVj,v >— Vf(v). The last equality follows trivially. Consequently, 
the prolongation and the gradient extension of a nonlinear system E which is itself 
gradient are externally equivalent, in particular weakly externally equivalent sys- 
tems. 

To prove the converse implication, we need some intermediate steps. □ 
Lemma 5.5. Let E be a nonlinear system of the form (I2.lt . Under the hypothesis of 
Theorem l5!4l assume that the prolongation E p and the gradient extension E e are weakly 
externally equivalent. Then there exists a unique diffeomorphism <p : TM — > T*M such 
that 

{<p)*9i = grad g c V 9i o tp , V^i o (p = Vf , 

i^g^g^dgcv/ocp, v yo? = vy, (S - Z) 

for all i = 0, 1, . . . , to, j = 1, . . . , m, Moreover, ip is a bundle morphism over the identity 
Mm : M — > M, i.e. in natural coordinates ip{x,v) — (x, (f>(x, v)), for certain map cf> : 
T X M -> T*M, x S M. 

Proof. By Proposition 13 .21 and Corollary 13. 61 we have that both the prolongation 
and the gradient extension are observable systems. Since they are also weakly ex- 
ternally equivalent by assumption, Corollary 14.41 ensures that there exists a unique 
diffeomorphism ip : TM — > T*M verifying J5.2I . Applying now Corollary 14.41 to 
E 1 = E = E 2 , we deduce that there exists a unique diffeomorphism from M to M 
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mapping the original nonlinear system to itself, namely the identity mapping. Us- 
ing uniqueness and the fact that tp satisfies \5.2\ . it then follows that tp is of the form 

tp(x, v) = (a:, (f>(x, v)), for certain map : T X M — > T*M, x G M. 

Lemma 5.6. Under the same assumptions as in Lemma l5!5l there exists a unique 

pseudo-Riemannian metric Q on M such that bg = tp, i.e. \>g(v) = tf>(x, v) for all v G T X M. 
Proof. It follows from V 9j o tp = Vf (cf. equation i5.2\ ) and the structure of the 

diffeomorphism tp that 

< 4>{x, v), gj(x) >=< dVj(x), v > , Vu 6 T X M , j = 1, . . . ,m. 

Furthermore, from (<p)*gf = gr&dV 9i o (see eq. d5 .^i ') , it follows that 

£ g rad V 9i o ip = C g c Vf , i = 0, 1, . . . , m , j = 1, . . . , m . 

Using now Lemma 1^41 (i), we get < <j>{x,v), (gi : gj)(x) >—< d(C gi Vj) (x),v >. In 
general for all v G T X M, 

< <fi(x, v), (X, : (X 2 : (X 3 , ...:(X S : 9j )) . . .))(x) > = 

=< d(C Xl C X2 ...Cx 3 V J )(x),v>, (5.3) 

with the X r , r = 1, . . . , s equal to some gi, i = 0,1, ... ,m. Since the right-hand 
side of this equation is linear in v and the distribution generated by the space S is 
full-rank by hypothesis, it follows that for each x G M there exists a unique matrix 
G{x) such that tp(x, v) = Q(x)v. Since <p is a diffeomorphism, Q{x) is non-singular for 
every x and depends smoothly on the base point. Consider the adjoint mapping of 
tp, tp T : TM ->■ T*M, defined by < tp(v), w >=< v, tp T (w) >,v,w G T X M, x G M. 
Then, tp T (x, v) = (x, G T {x)v). It follows from i5.3\ that Q{x) satisfies 

p T ((X 1 : (X 2 : (X 3 , ...:(X S : 9j )) . . .)){x)) =d(£ Xl £ X2 . ..jCx^Vj) (x) , (5.4) 

with the X r as above. Let us see now that Q{x) = Q T (x). Note that in local coordi- 
nates (tp)*g^ = grad^c VJ o tp yields, 

( &(/(*)«) ot) ) ( 9j ix) ) = ( (^) T (x) ) ' 

or, equivalently, Q(x)gj(x) — (dVj/dx) T (x), j = 1, . . . ,m, which in intrinsic terms, 
can be written as tp[gf) = dVj. Now, 

< tp ((X, : (X 2 : (X 3 , (X Sl : 9j )) . . .))) , (Y 1 : (Y 2 : >;;....: (Y S2 : g k )) ...))> 
=< {X x : (X 2 : (X 3 , (X Sl : 9j }) . . .)),tp T «y x : (Y 2 : );....: (Y S2 : g k )) . . .))) > . 

Using J5.4L the latter is equal to 

< (X, : (X 2 :(X 3 ,...: (X S1 : 9j )) . . .)},d£ Yl £y 2 . . . £ y , V k > 

=< d£ Xl £ X2 . . . £ x Vj, {Y x : (Y 2 : (. . . : (Y S2 : g k )) ...))>, 

where in the last equality we have used the property (a) of the compatibility defini- 
tion between the nonlinear system E and the affine connection V. Finally, 

< pdX, : (X 2 : (X 3 , (X Sl : 9j )) . . .))) , (Y, : (Y 2 : (Y S2 : g k )) ...)>> 
=< p T ((X, : (X 2 : (X 3 , {X Sl : 9j )) . . .))) , (Y x : (F 2 : (. . . : (Y S2 : fffc )) ...))>, 
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By the assumption on the full-rankness of the distribution So, we conclude that 

<pi(X 1 :{X 2 :(X 3 ,...:(X. 1 :g j ))...))) = 

= tp T ({X 1 :{X 2 :{X 3 ,...:{X sl :g j ))...))) , 

which in turn implies that <p(x) = (p T (x), i.e., the matrix Q(x) is symmetric. □ 

Lemma 5.7. Under the same assumptions as in Lemma \5^5\ the torsion-free affine con- 
nection V is the Levi-Civita connection corresponding to the pseudo-Riemannian metric Q. 
Proof. First of all, note that 

<V {{X 1 :{X 2 :(..,(X s : gj ))...)): { Yy^^ 

= ^((X 1 :(X 2 :(..,.(X s :g J ))...)):{Y 1 :(Y 2 :(..,.(Y S2 : gk ))...))) [£z 1 £z 2 ■ ■ ■ Cz^Vl] 

= £{Z 1 :(Z 2 :(...:{Z S3 :g l ))...)) [£{X X : (X 2 :(...: (X B :g 3 ))...) ) [C Yl ^Y 2 ■ ■ ■ C Ys2 V k ] ] (5.5) 
= < (£{X 1 :{X 2 :{...:{X 3 :g j ))...)) [C-Y^Y, ■ ■ ■ ^Y B2 V k ]) ° (f^ 1 , d(£ Zl £z 2 ■ ■■Cz s Vl) > ■ 

Since the observation space of the nonlinear system E is generated by the functions 
of the form Cz 1 Cz 2 ■ ■ ■ £z S3 V\, and E is observable by hypothesis, we conclude that 

v ((X 1 :(X 2 :(...:(X s :g J ))...)):( Yl :( Y2 :(...:( Ys2 :g k ))...))) Q _ 

= (£{X 1 :(X 2 :{...:{X,:g j ))...)) [^Cy, . . . C Ys2 V k ]) C . 

Given the structure of the mapping ip (cf. Lemmas 15.51 and I5~6l , and equation J5.4I , 
this equality can be rewritten as, 

GdiX, :{X 2 :{...: (X s : 9j )) ...)): (Y 1 : (Y 2 : {. . . : {Y S2 : g k )) . . .))), •) 

= d < ^((n : (Y 2 ; (. . . : (Y S2 : g k )) . . .})), {X 1 : (X 2 ; (. . . : (X s : fli >> •■•)>> 
= d (^(grad g (£ Yl £ Y2 . . . C Ys2 V k ) , grad g (£ Xl £x 2 ■■■£x e Vj))) 

= d{C Yl C Y2 . . . Cy S2 V k : Cx t Cx 2 ■ ■ ■ £x s Vj}g . 

Since grad g {/ : g}g = (gradg / : grad g j) v s,we conclude 

({X 1 :(X 2 :{...:{X s :g j ))...)):{Y 1 :(Y 2 :{...:{Y S2 :g k }). ..)}) = 

= {(X x : (X 2 : (. . . : (X s : 9j )) ...)): <y x : {Y 2 : (. . . : (F S2 : flfc )) . . . 

Using the fact that S is full-rank, we deduce that (X ; Y) = {X : Y)g for all X, 
Y £ X(M). Finally, using the fact that V is torsion-free, we compute 

V X Y = ~ ((X : Y) + [X, Y])= l -{(X: Y)g + [X, Y]) = V G X Y , VX, Y e X(M) , 

which concludes the result. □ 

We are now ready to conclude the proof of Theorem l5.4l 

Proof of Theorem l5~4l <=) Assume the prolongation S p and the gradient extension 
E e are weakly externally equivalent. From Lemmas 15.51 15.61 and !5.7l we deduce the 
existence of a pseudo-Riemannian metric Q on M such that V = V e and the unique 
diffeomorphism between TM and T*M relating TP and E e and verifying (15.21 is 
\>g. From (bg)*5j = grad gc VJ o bg, we deduce \>g(gj) = dVj, and hence grad e Vj — 
gj, j — 1, . . . , m. Finally, we show that go is a locally gradient vector field. From 
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(bg)*9o = gradgc V 9 " o b g and the local expression I2.8t of the Christoffel symbols of 
the Levi-Civita connection V , we deduce that 

d d 

which implies that the one-form \>g(go) is closed. □ 

Remark 5.8. Note that, given the torsion-free affine connection V, the pseudo- 
Riemannian metric Q obtained in the proof of Theorem 15 .41 is unique such that £ is 
locally gradient with respect to it. In Section[6]below, we investigate the uniqueness 
(up to isometry) of gradient realizations with the same input-output behavior. 

REMARK 5.9. In general, we cannot ensure that the drift vector field go is globally 
gradient, unless we impose some additional conditions on the topology of the state 
space M (for instance, that the first Betti number of M is zero). This is analogous to 
the situation in the Hamiltonian setting 1 1121 . 

Remark 5.10. One can verify that the pseudo-Riemannian metric on TM de- 
fined by (bg)*G c corresponds to the complete lift to TM of the original metric Q on 
M (see El). 

REMARK 5.11. A different way to prove the same result which indeed keeps a 
closer parallelism with the proof for the Hamiltonian case 1 12 1 would be the follow- 
ing. Once one has proved Lemmas 15.51 and !5.6l instead of proving Lemma 15.71 one 
can show that 

:(X2 ■■{■■■■■ (X s : g 3 )) . ■ -)) c = gradV<*' ! < x * : <- : <*' ! «»-» o <p , (5.6) 

for any j £ {1, . . . , to} and X r £ {g , gi, ■ ■ ■ , g m }, r = 1, . . . , s. This can be done by 
considering the following vector fields on T*M, 

Z 1 = fo>)„<Xi :(X 2 :(...: (X a : 9j )) . . .}} c o ^ , 
Z 2 = gradW Xi: ^ : <- : ^*»-)>, 

and showing that their action on the observation space TC e of E e is the same. To see 
this, recall from Proposition 13.51 that H e = V s ° + (H + f)) v . Consider a function of 
the form £x 1 £x 2 ■ ■ ■ £-x a Vj, with X r , r — 1, . . . , s, equal to gi, i = 0, 1, . . . , to, and 
j = 1, . . . , to. Then, 

£>Zx [{£-x 1 £-x 2 ■ ■ -£x a Vj) ] — 

= {£(X 1 :{X 2 :{..,.{X 3 :g J ))...))c {(£ Xl £x 2 ■ ■ ■ C X . Vjf O ip}) O^" 1 = 

= (£{X 1 :{X 2 :{...:{X B :g J ))...)) [£ Xx £ X2 ■ ■ ■ C-X.Vj]) , 

where we have used twice the fact that ip is the identity mapping on the base mani- 
fold M. On the other hand, 

£-Z 2 [{C Xl Cx 2 ■■■£x s V j y] = (C{ Xl :(X 2 :(...:{X s : gj ))...)) [C Xl Cx 2 . . . Cx.Vj]) , 

using property (ii) in Lemma l3~4l The same argument also guarantees that the action 
of Z\ and 2 2 is the same over the vertical lifts of the functions spanning f). Finally, 
let {Y 1 : (Y 2 : (. . . : (Y S2 : g k }) . . .}} £ S and consider the corresponding function on 



Characterization of gradient control systems 



17 



T * M/V (Y 1 :(Y 2 :(..,(Y S2 :g k ))...))_ ^ 



C2 



V 



(Y 1 :(Y 2 :(...:(Y S2 :g k ))...)) 



= (£(X i: (X,:,.,(^,))...,)' ^(V,:(V.:(..,(^,, fe »...» ^ ^ , = 
= (£(Xi:(X !t :(...:{X a :g j ))...))<: [(C Yi Cy 3 ■ ■ ■ ^Y„ 2 V k ) C ] ) o (^T 1 

= (^<X i: (X 2 :<...:<X 5 : fl; ,»...» [^1 ^ ■ ■ ■ C Yt2 V k ] ) ° O yT 1 , (5.7) 

where we have used equation 15.41 . In addition, 



V 



(Y 1 :(Y 2 :(..,.(Y B2 :g k ))...)) 



= v ({X 1 :(X 2 :(..,.(X s :g J ))...)):(Y 1 :(Y 2 :(..,.(Y S2 :g k ))...))) ^ ,g 



where we have used property (i) in Lemma l3~4l Now, equation 15.51 implies that <5.7t 
and 15.81 coincide. Therefore, Z\ and Z 2 coincide over H e , and this concludes the 
proof of I5.6L 

Now, one can proceed by taking local coordinates (x 1 , . . . ,x n ) in M such that 
every coordinate function x' 1 is of the form Cx x ■ ■ ■ C-x s Vj for a certain j 6 {1, . . . , to} 
and certain vector fields X r 6 {go, Si, ■ ■ ■ , 9m}/ r = 1, . . . , a. It follows from <!5.4i that 
there exists n independent vector fields k 1 , . . . , k n of the form (X\ : (X% :(...: (X s : 
gj}} . . .}} such that \>g(k l ) = dx % . Finally, spelling out eq. fo.6l for the vector fields k l 
and making use of the symmetry of Q, one obtains that the Christoffel symbols of the 
affine connection V are precisely given by 12.81 . which concludes the result. 

6. Uniqueness of the gradient realization. In this section, we investigate the 
gradient analog of the following well-known result for Hamiltonian systems: if two 
minimal Hamiltonian systems have the same input-output map, then they are sym- 
plectomorphic 151 1211 . We will see how the setting of Theorem 15.41 also provides 
sufficient conditions under which a similar result holds for gradient realizations. 

In 1 23 1, P. Varaiya conjectured that if there exists a state space diffeomorphism be- 
tween two locally controllable gradient systems, then the diffeomorphism is actually 
an isometry between the underlying pseudo-Riemannian manifolds (see also |24|). 
Subsequently, in QQ, J. Basto Goncalves produced an example of two locally con- 
trollable and observable gradient systems living on the same state space with state 
space diffeomorphism given by the identity mapping, where however the Rieman- 
nian metrics are different; thus providing a counterexample to the conjecture by 
Varaiya. For the sake of completeness, we review it in the following. 

Example 6.1 (QUI). Consider two gradient systems E 1 and E 2 on M 1 = M 2 = 
K 4 with Riemannian metrics Q 1 and Q 2 given respectively by 

Q l {x\,X2,xz,Xi) = dx\ ® dx\ + e~ Xi dx 2 <S> dx2 + e~ Xl dx 3 £g> dx3 + e~ X3 dx4 <g> dx 4 , 
G 2 (xi, x 2 , x 3 , x±) = dxi ® dxi + e~ Xi dx 2 <8> dx 2 + (e~ Xl + e X3 )dx 3 <g> dx 



3 



+ e X3 (1 + e 2xi )dx4 ® dxi - e Xl (dx 3 ® dx 4 + dx 4 ® dx 3 ) . 

Furthermore, let S 1 and S 2 have both zero drift vector fields and the same output 
functions given by 



yi = Vi{x) := xi , y 2 = V 2 (x) := x 2 + x 3 + x 4 . 
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From the definition of Q 1 and Q 2 , it easily follows that the input vector fields of both 
systems are the same, i.e., 



Therefore, E 1 and E 2 are externally equivalent with state space diffeomorphism 
given by the identity mapping Id : M 4 — > R 4 . However, the metrics Q 1 and Q 2 are 
different, and hence the identity mapping is not an isometry. It should also be noted 
that E 1 and E 2 are both controllable and observable. 

The following result shows that, under the hypotheses of Theorem 15.41 a state 
space diffeomorphism linking two gradient systems is an isometry, provided the state 
space diffeomorphism is already known to respect the affine connections determined 
by their respective pseudo-Riemannian metrics. A similar statement is already con- 
tained in 1 1 2|. Here we make use of an argument given in |12|, p. 58 for the case of 
Hamiltonian systems. 

Proposition 6.2. Let E 1 and E 2 be two gradient systems with state spaces (M 1 , Q 1 ) 
and (M 2 ,Q 2 ), respectively. For i = 1,2, assume that E 4 is observable with dim dW con- 
stant, and that the distribution <Sq is fidl-rank. Furthermore, let E 1 and E 2 be externally 
equivalent with the corresponding state space diffeomorphism ijj : M 1 — ► M 2 satisfying 



Mv£Y)<»l>~ l =v£x od-iOMW 1 ). fi>rallX,Y elfM 1 ). (6.1) 



Then ip*G 2 = Q 1 , that is, ip is an isometry. 

Proof. By Lemmas 15 .51 and 15 . 61 the map ip l = \>gi is the unique diffeomorphism 
satisfying J5.2I for system E 4 , i = 1,2. It is easily checked that since E 1 and E 2 are 
externally equivalent with state space diffeomorphism ip, then their prolongations 
E lp and E 2p are externally equivalent with uniquely determined state space diffeo- 
morphism given by ip* : TM 1 — * TM 2 . Furthermore, it can be readily checked that 
the gradient extensions E le and E 2e are externally equivalent with state space dif- 
feomorphism ip* : T*M 2 — > T*M X , provided tp satisfies \6.1\ . This is because <6.1> 
implies that ip* respects the Pviemannian extensions (5 C ) 1 and (Q c ) 2 determined, re- 
spectively, by the affine connections V 1 and V 2 . Hence, by the uniqueness of all 
these state space diffeomorphisms, we obtain the following commutative diagram 



grad g i Vi = grad 6 2 V\ 



d 



grad e i V 2 = grad g2 V 2 




TM 1 



TM 2 



T * M i 



T*M 2 



that is, 



tfj* O (f 2 O tfj^ — if 1 . 



(6.2) 



Recalling that cp 1 = ig%, i = 1, 2, it is readily seen that i6.2i is equivalent to 



^*g 2 = g 1 



(6.3) 
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that is, ip : [M 1 , C/ 1 ) -> (M 2 , g 2 ) is an isometry. □ 

REMARK 6.3. Note that in Example l6. li the torsion-free connections determined 
by Q 1 and Q 2 are different, and hence the identity map does not respect them. 

REMARK 6.4. Since eq. (16.21 is equivalent to eq. t6.3> . one may also conclude that 
under the conditions of Theorem 15. 41 the state space diffeomorphism ip : M 1 — ► M 2 
is an isometry if and only if : T*M 2 — ► T*M 1 is a state space diffeomorphism 
between S le and S 2e . 

7. Conclusions. We have discussed necessary and sufficient conditions for a 
nonlinear control system to be realizable as a gradient control system with respect to 
a pseudo-Riemannian metric. The results rely on a suitable notion of compatibility 
of the system with respect to a given affine connection, and on the input-output be- 
havior of the prolonged system and the gradient extension. The symmetric product 
associated with an affine connection plays a key role in the discussion. We believe 
that the developments in this paper do not only give insight in the system-theoretic 
properties of the physically motivated class of gradient control systems, but also 
shed light on the differential-geometric properties of gradient and Lagrangian con- 
trol systems. Future work will include the investigation of equivalent characteriza- 
tions in terms of the input-output behavior of the original nonlinear system. 
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8. Appendix. In this appendix we present a simplifying result concerning the 
compatibility hypothesis in the statement of Theorem l5.4l In general, checking con- 
ditions (a) and (b) in the definition of compatibility between the affine connection V 
and the nonlinear system £ cannot be performed for every possible choice of vec- 
tor fields in {g , gi, ■ ■ ■ , g m } and {V\, . . . , V m }. The following result shows that it is 
enough to check the compatibility condition on a basis of vector fields and the corre- 
sponding associated functions once we know that the prolongation and the gradient 
extension of S are weakly externally equivalent. 

Lemma 8.1. Let V be a torsion-free affine connection. Assume X is observable with 
dim dH constant, and that the distribution So is full-rank. Assume the prolongation E p and 
the gradient extension E e of S are weakly externally equivalent. Then £ is compatible with 
V if and only if properties (a) and (b) are verified by a basis of vector fields in So- 
Proof. Let Ri, . . . , R n be linearly independent vector fields of the form Ri = 
(X\ : (X% : (• ■ • : {XI : g n )) . . .)}, i = l,...,n. Let V Ri denote the function on 
M given by C X i . . . C X ' s Vj v From equation J5.4L we know that ip T (Ri) = dV^. 
Assume properties (a) and (b) in the definition of the compatibility condition (cf. 
Definition 15.11 are verified by any combination of the vector fields R\ , . . . , R n and 
the functions Vr ± , ■ ■ ■ , Vr k . Let X — {X ± : (X 2 :(...: {X s : g k )) . . .)} be any element 
of So, and Vx — Cx x Cx 2 ■ ■ ■ £x 3 Vk the associated function on M. Since So is full- 
rank, we have that X = Y27=i fx^i- Then, 

n n 

dV x = dC Xl C X2 . . . £x B V k = ^ T (X) = = E fx^Ri ■ 

i=l i=l 

Now, let us see that properties (a) and (b) are naturally verified by all possible choices 
of vector fields in So and generating functions in H. First, 

£(X 1 :(X 2 ;{...;{X B1 :g j ))...)) [^Y 1 Cy 2 . . . C Ys V k ] 

n I n \ n n / n \ 

= E tidViu E fx** = E fyfxdV Rj (Ri) = E f x dv R] E 
i=i J i,j=i j=i / 

= £(Yr.(Y 2 :{...:{Y S2 :g k ))...)) [CXi £x 2 ■ ■ • £x, ± Vj] , 
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where we have used that condition (a) is verified by the vector fields Ri , . . . , R n and 
the functions Vr ± , . . . , Vr^ . Secondly, 

£({X 1 :(X 2 :(..,.(X sl :g J ))...)):(Y 1 :(Y 2 :(..,.(Y S2 :g k ))...))) [C Zl Cz 2 ■ ■ ■ C Za Vl] 
n in \ n 

= J2fz dV *> H-fU-.Y)^ = E fzfU-.Y)^ (^) 

■ I \i ■ J i,3=l 

n / n \ n 

= E f(X:Y)dV Rj E =< E f{x:Y)dV Rj ,Z>. (8.1) 

3=1 \i=l J 3 = 1 

Let us compute the coefficients fi x . Y \ ■ We have 

«X a : {X 2 : (. . . : (X Sl : 9j )) ...)): (y x : <F 2 : (. . . : (F S2 : g k )) . . .)» = 

n n 

E </ii2« = f Y Rj) = E (/'v/v />'- = R j) + fxRilftiRj + fv«, fV". 

n / n n n \ 

= E E • E-^'-' /'v • E-Wv ^- 

fe=l \i,j=l i=l j=l / 

Now, note that Efc=i < f{R i :R j ) dV ^' R ^ >= £fc=i < f{R,:R 3 ) dv Rn Rk > using 
condition (a) for the vector fields R\ , . . . , R n and the functions Vr 1 , . . . , V Rn . More- 
over, using condition (b), J2k=i < f{Ri-. Rj )dVRi > R k >=< dV Rl ,(Ri : Rj) >=< 
d(dV Rt [Rj]),Ri >■ Hence, £)£ =1 f^ R . :R . } dV Rk = d{dV R% [Rj]). On the other hand, 

f x Ri[f Y ]dV Rk = f x < df Y ,Ri > dV Rk 

= f x < dV Rh ,Ri > df Y + f x (df Y A dV Rk ) (Ri, •) 

Since f x (df Y A dV Rk ) (R t , •) = f x (d (f Y dV Rk )) {R u ■) = f x (d (dV Y )) {R u ■) = 0, we 
have 

f x Ri[f Y ]dV R , = f x < dV Rk ,Ri > df Y . 
Analogously, one can see that JyR 3 [f x ]dVR k = fy < dVR k , Rj > df x . Finally, 

n n I n n n \ 

fc=l fc=l \i,i=l 2=1 .7=1 / 

n n n 

= E fxf Y d(dV Ri [Rj]) + E /l < dVn, , ^ > 4# + E # < ' ^ > d ^ 

ij'=l «,J=1 ij'=l 

= d ( E /'v/v' /l » [^] j = d(C Y [Fx]) . 
Plugging this equality in JS.li . we get the desired result. □ 



